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1 

DISTRIBUTED COMPUTER 



The present invention relates to a distributed computer and to a method of operating 
a computer forming a component of a distributed computer, 

5 

The relatively low cost of today's microprocessors mean that the most economic way 
of building a powerful computer is to interconnect a number of low cost 
microprocessors to provide a distributed computer. Although a purpose-built 
distributed computer will often be a unit of equipment comprising tens or hundreds of 
10 processors interconnected via a high-speed bus, the common arrangement of 
desktops PCs interconnected by an office LAN is also a form of distributed computer. 

One application of a distributed computer is the carrying out of a task which is too 
demanding to be solved quickly by a computer having a single processor. In such a 
1 5 case, it is necessary to divide the task to be performed amongst the plurality of 
processors present in the distributed computer. This is known as processor 
allocation or 'load balancing'. 



Distributed computers should also be tolerant to the failure or shutdown of one of the 
processors within them - systems of this type are disclosed, for example, in 
International Patent Application WO 01/82678, and European Patent applications 0 
887 731 and 0 750 256. 



A number of processor allocation or load balancing algorithms have been disclosed. 
In EAGER D.L, LAZOWSKA, E.D., and ZAHORJAN, J.: "Adaptive Load Sharing in 
Homogeneous Distributed Systems," IEEE Trans. On Software Engineering, vol. SE-12, 
pp. 662-675, May 1986, three algorithms are considered. One of those algorithms 
involves each processor creating a new process (i.e. contemplating starting another 
component of the task) in: a) finding whether it is overloaded, and, b) sending the new 
process to another randomly-chosen processor. The processor receiving the new 
process then carries out a similar procedure. This continues either until a processor 
accepts the new process or a hop-count is exceeded. 
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In other algorithms, one or more processors is given the task of tracking how heavily- 
loaded other processors in the distributed computer are. If the processors within the 
distributed computer are organised into a logical hierarchy independent of the 
physical structure of the network interconnecting the different processors, the task of 
5 monitoring (eveis of usage of the processors can be split-up in accordance with that 
hierarchy. An example of this is seen in W1TTIE, L.D., and VAN TILBORG, A.M.: 
"MICROS, a Distributed Operating System for MiCRONET, A Reconfigurable Network 
Computer," IEEE Trans. On Computers, vol. C-29, pp. 1133-1144, Dec 1980. New 
processes can be generated anywhere within the logical hierarchy and are escalated 
1 0 sufficiently far up the hierarchy to a 'manager 1 processor which has a sufficient number of 
subordinates to carry out the task. The manager then delegates the component tasks 
back down the hierarchy. 

According to a first aspect of the present invention, there is provided a method of dividing 
5 a task amongst a plurality of nodes within a distributed computer, said method 
comprising: 



receiving requirements data indicating desired properties of a task group of 
nodes and interconnections between them, which properties lead to said task group 
20 being suited to said task or tasks of a similar type; 

calculating a task group topology in dependence upon said requirements 
data; and 



distributing said task amongst the plurality of nodes in accordance with the 
task group topology thus calculated. 

By calculating task group topology data representing nodes and interconnections between 
them in dependence on requirements data entered by a user / administrator, and then 
distributing a task to be performed between nodes in accordance with the calculated 
topology, a more flexible method of utilising the resources of a distributed computer than 
has hitherto been known is provided. It is to be understood that the task group will not 
necessarily equate to the physical topology of the nodes and interconnections between 
them in the distributed computer. The nodes and connections used will often be a subset 
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of those available - also a logical connection represented in the task group topology data 
might represent a concatenation of a plurality of physical connections. 

Preferably, said topology calculation comprises the step of comparing said 
5 requirements data with node capability data for a node available to join said task 
group. This provides a convenient mechanism for automatically generating the task 
group topology. 



Preferably, said requirements data is arranged in accordance with a predefined, data 
10 structure defined by requirements format data stored in said computer, said method 
further comprising the step of verifying that said requirements data is formatted in 
accordance with predefined data structure by comparing said requirements data to 
said requirements format data. Defining the format of said requirements data in this 
way allows for easier communication of requirements data between computers. In 
15 preferred embodiments, the extensible Markup Language (XML) is used to define the 
format data, and known XML parsing programs are used to check the format of 
requirements data. 



Similar considerations apply to the node capability data. 

20 

In some embodiments, said method further comprises the step of operating a node 
seeking to Join said task group to generate node capability data and send said data to 
one or more nodes already included within said task group. 

25 Advantageously, said task distribution involves a node forwarding a task to a node 
which neighbours it in said task group topology. This provides a convenient way of 
utilising the generated topology in the subsequent calculation. 

According to a second aspect of the present invention, there is provided a distributed 
30 computer apparatus comprising: 



a plurality of data processor nodes, each connected to at least one other of 
said data processor nodes via a communications link; 
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10 



each of said nodes having recorded therein: 

a) group membership policy data; 

b) a list of group members; 

0 processor readable code executable to update group membership data, 
said code comprising: 

group membership request generation code executable to generate and send 
a group membership request including node profile data to another node indicated to 
be a member of said group; 

15 group membership request handling code executable to receive a group 

membership request including node profile data, and decide whether said request is 
to be granted in dependence upon the group membership policy data stored at said 
node; 

20 group membership update code executable to update the list of group 

members stored at said node on deciding to grant a group membership request 
received from another node, and to send a response to the node sending said request 
indicating that said request is successful. 

25 Advantageously, each node further has recorded therein received program data 
execution code executable to receive program data from another of said nodes and to 
execute said program. Preferably, said plurality of processor nodes comprise 
computers executing different operating systems programs, and said received 
program execution code is further executable to provide a similar execution 

30 environment on nodes despite the differences in said operating system programs. 
This means that embodiments of the invention can carry out calculations across a 
heterogeneous computer network and increases the possibilities for utilising the 
processing power and memory of idle computers in a typical computer network 
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comprising computers based on different hardware architectures and/or running 
different operating system programs. 

According to a third aspect of the present invention, there is provided a method of 
operating a member node of a distributed computing network, said method 
comprising: 



accessing membership policy data comprising one or more property value 
pairs indicating one or more criteria for membership of said distributed computing 
1 0 network; 



receiving, from an applicant node, profile data comprising one or more 
property value pairs indicating characteristics of the applicant node; 



15 



determining whether said applicant profile data indicates that said applicant 
node meets said membership criteria; 



responsive to said determination indicating that said applicant node meets 
said membership criteria, updating distributed computing network membership data 
20 accessible to said member node network to indicate that said applicant node is a 
member node of said distributed computing network. 

By controlling a member node of a distributed computing network to compare profile 
data from another computer with criteria indicated by membership policy data 

25 accessible to the member node, and updating distributed computing network data 
accessible to the member node if said profile data indicates that said one or more 
criteria is met, a distributed network whose membership accords with said policy 
data is built up. Provided the policy reflects the distributed task that is to be shared 
amongst the members of the distributed computing network, a distributed computer 

30 network whose membership is suited to the distributed task to be shared is built up. 

Preferably, the member node stores said distributed network membership data, This 
results in a distributing computing network which is more robust than networks 
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where this data is stored in a central database. Similarly, in some embodiments, said 
member node stores said membership policy data. 

In preferred embodiments, the method further comprises the steps of: 

updating said membership policy data; 

removing indications that one or more nodes are members of said distributed 
computing network from said distributed computing network membership data; and 

sending an indication to said one or more nodes requesting them to re-send 
said profile data. 

This allows the distributed computing network to be dynamically reconfigured in 
response, for example, to a change in the task to be performed or the addition of a 
new type of node which might apply to become a member of the distributed 
computing network. 

According to a fourth aspect of the present invention, there is provided a computer 
program product loadable into the interna! memory of a digital computer comprising: 

task group requirements data reception code executable to receive and store 
received task group requirements data; 

node capability profile data reception code executable to receive and store 
received node capability profile data; 

comparison code executable to compare said node capability data and said 
task group requirements data to find whether the node represented by said node 
capability data meets said task group requirements; 
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task group topology update code executable to add an identifier of said 
represented node to a task group topology data structure on said comparison code 
indicating that said represented node meets said requirements; 

task execution code executable to receive code from another node in said 
task group and to execute said code or forward said code to a node represented as a 
neighbour in said task group topology data structure. 



10 By way of example only, specific embodiments of the present invention will now be 
described with reference to the accompanying Figures in which: 

Figure 1 shows an internetwork of computing devices operating in accordance with a 
first embodiment of the present invention; 

15 

Figure 2 shows a tree diagram representing a document type definition for a profile 
document for use in the first embodiment; 

Figure 3 shows a tree diagram representing a document type definition for a policy 
20 document for use in the first embodiment; 

Figure 4 shows the architecture of a software program installed on the computing 
devices of Figure 1 ; 

25 Figure 5 is a flow-chart of a script (i.e. program) which is run by each of the 
computing devices of Figure 1 when they are switched on; 

Figure 6 shows how a node connects to a distributed computing network set up 
within the physical network of Figure 1; 

30 

Figure 7 is a flowchart showing how each of the computing devices of Figure 1 
responds to a request by another computer to join a task group of computing devices 
for performing a distributed process; 
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Figure 8 is a fidw-chart showing how each of the computing devices of Figure 1 
responds to a received policy document; and 

5 Figure 9 illustrates how the topology of the task group is controlled by the policy 
documents stored in the computing devices of Figure 1 . 

Figure 1 illustrates an internetwork comprising a fixed Ethernet 802.3 local area 
network 10 which interconnects first 12 and second 14 Ethernet 802.11 wireless 
10 local area networks. 



Attached to the fixed local area network 10 are a server computer 218, and three 
desktop PCs {219, 220, 221). The first wireless local area network 12 has a 
wireless connection to a first laptop computer 223, the second wireless local area 
15 network 14 has wireless connections to a second laptop computer 224 and a 
personal digital assistant 225. 

Also illustrated is a compact disc which carries software which can be loaded directly 
or indirectly onto each of the computing devices of Figure 1 (218 - 225} and which 
will cause them to operate in accordance with a first embodiment of the present 
20 invention when run. 

Figure 2 shows, in tree diagram form, a Document Type Definition {DTD} which 
indicates a predetermined logical structure for a 'profile' document written in 
extensible Mark-Up Language (XML). The purpose of a 'profile' document is to 
provide an indication of the storage, processing and communication capabilities of a 
25 computing device, 

As dictated by the DTD, a profile document consists of eight sections, some of 
which themselves contain one or more fields. 

In the present embodiment, the eight sections relate to: 

a) general information 20 about the computing device; 
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b) JVM information 22 about the Java Virtual Machine software installed on the 
device; 

c) processor information 24 about the processor(s) contained within the device; 

d} volatile memory information 26 about the volatile memory contained within the 
5 device; 

e) link information 28 about the delay encountered by packets sent from the device 
to a neighbouring device; 

f) utilisation information 30 about the amount of processing recently carried out by 
the processor(s) within the computing device; 

10 gi permanent memory information 32 about the amount of permanent memory within 
the device; and 

h) physical topology information 34 - this comprises a list of Internet Protocol 
addresses for the immediate neighbours of the device. The physical topology 
information is input to the echo pattern information distribution scheme described 
1 5 below. 



An example of an XML document created in accordance with the DTD shown i 
Figure 2 is given below: 

20 < ?xml versi on='1.0>?> 

<profile> 

<!•- Prom the system properties 
25 <JVMVersion>l . 4 , 0-beta2-b77</JVMVersion> 
<JRVersion>l , 4 , 0~beta2-b77</jRVersion> 
<OSVer>2,4 . 12</OSVer> 
<JavaVer>1.4 . 0-beta2</JavaVer> 
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</-- From the 'cpuinfo' file ~-> 
</-- infos about the cpu model and bogomips~~> 
<ruodelname>PentiumIII (Coppermine) </modelname> 
<bogomips>1723 . 59</bogomips> 

5 

</-- From the 'meminfo' file --> 

</-- infos about memory: amount of total and --> 
<-'-- free physical mem (RAM and swap mem) --> 
<MemTo tal>ll846 0kB< /MemTo tal > 
10 <MemFree>12188kB</MemFree> 

< SwapTo tal>9634 8kB< /SwapTo tal > 
< SwapFree> 8 7944kB</3wapFree> 

</-- From the 'ping' file --> 
15 </-- infos about the inin, max and avg throughput --> 
<min>0. 044</min> 
< a vg> 0 .195< /avg> 
<max>0. 647</max> 
<mdev>0. 261</mdev> 

20 

<!-- From the 'loadsvg' file --> 
<-'-- infos about the average load ~-> 
</-- of the last 1, 5 and 15 min --> 
<avgldl>0 .02</avgldl> 
25 <avgld5>0.03</avgld5> 
<avgldl5>0. 00</avgldl5> 

</-- From the ' df ' file --> 

</-- infos atout the HD(s); name (mount point) --> 
30 </~- total capacity and available space --> 
< HDName> de v< /HDName> 
<HDTotal>2440</HDTotal> 
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<HDUsed>l711< /HDUsed> 

<HDName>dev</HDName> 
<HDTotal>16496</HDTotal> 
5 <HDUsed>12007</HDUsed> 

< topology Info 
<neighhours> 

<neighbour> 196.168.255,10 < /neighbour 
10 <neighbour> 196.168.255.128 < /neighbour 
</neighbours> 
</topologyIn£o> 

</profile> 



15 

The fields specified in the Document Type Definition and the values placed in the 
above profile written in accordance with that DTD will be self-explanatory to those 
skilled in the art. The generation of a profile document in accordance with the above 
DTD will be described further on, 

20 Figure 3 shows, in tree diagram form, a Document Type Definition (DTD! which 
indicates a predetermined iogical structure for a 'policy' document written in 
extensible Mark-U P Language (XML). One purpose of a 'policy' document in this 
embodiment is to set out the conditions which an applicant computing device must 
fulfil prior to a specified action being carried out in respect of that computing device. 
25 in the present case, the action concerned is the joining of the applicant computing 
device to a distributed computing network. 

Policy documents may also cause the node which receives them to carry out an 
action specified in the policy. 

As dictated by the DTD, a profile document consists of two sections, each of which 
30 has a complex logical structure. 
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The first section 100 refers to the creator of the policy and inciudes fields which 
indicate the ievei of authority enjoyed by the creator of the policy {some computing 
devices may be programmed not to take account of policies generated by a creator 
who has a level of authority below a predetermined level), the unique name of the 
5 policy, the name of any policy it is to replace, times at which the policy is to be 
applied etc. 

The second section 102 refers to the individual computing devices or classes of 
computing devices to which the policy is applicable, and sets out the applicable 
policy 104 for each of those individual computing devices or classes of computing 
1 0 devices. 

Each policy comprises a set of 'conditions' 106 and an action 108 which is to be 
carried out if all those 'conditions' are met. The conditions are in fact values of 
various fields, e.g. processing power (represented here as 'BogoMIPS' - a term used 
in Linux operating systems to mean Bogus Machine Instructions Per Second} and free 
15 memory. It will be seen that many of the conditions correspond to fields found in a 
profile document. 

An example of an XML document created in accordance with the DTD shown in 
Figure 3 is given below. 

20 <?xml version = "1.0" encoding = n UTF-8"?> 

< policy xmlns:xsi = "http://www.w3.org/2001 /XMLSchema-instance" 
xsimoNamespaceSchemaLocation = "base_policy.xsd" > 
< create r> 

< authority > 

25 < admin-domain > ferdina < /admin-domain > 
< role > administrator < /role > 
< /authority > 

< identity > Antonio Di Ferdinando< /identity > 

< reply-address >ferdina@drake. bt.co.uk < /reply-address > 
?0 < /creator > 

<info> 
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< unique-name > my Policy < /unique-name > 

< description > policy di prova< /description > 

< priority > norma) < /priority > 

< start-date > 200 1 . 1 2 . 1 2 < /start-date > 

< expiry-date > 2002.01 .31 < /expiry-date > 

< replaces/ > 
</info> 

< sender > 
< /sender > 
< subject > 

<!--domain or subject fist— > 

<!--< domain > 

<doma/nName>futures.bt.co.uk</domainName> 
< /domain >--> 

< subject-list > 

<subjects> 

<host>132.146.107.218</host> 
< conditions > 

< action > join < /action > 

<conditionSet> 

<SWConditions> 

<OSVer>2.4.16</OSVer> 

< OS Arch > Linux < /OSArch > 
</SWConditions> 
<HWConditions> 

<CPU> 

< number > 2 < /number > 

< model > Pentium ltl< /model > 
</CPU> 
<HD> 

< HDTotal > 1 1 2000K </HDTotal> 

</HD> 
</HWConditions> 
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< otherConditions > 

< maxNeighbours > 3 < /maxNeighbours > 
</otherConditions> 
</conditionSet> 
5 < /conditions > 

< /subjects > 
<subjects> 
<host>132.146.107.219</host> 
< conditions > 
10 < action >join< /action > 

<conditionSet> 
< otherConditions > 

< maxNeighbours > 3 < /maxNeighbours > 
< /otherConditions > 

15 </conditionSet> 
< /conditions > 
< /subjects > 
< /subject-list > 
< /subject > 
20 < /policy > 



Figure 4 shows the architecture of a software program recorded on the compact disc 
16 and installed and executing on each of the computing devices (218-225) of Figure 
1. The software program is written in the Java programming language and thus 
25 consists of a number of 'class' files which contain bytecode which is intertable by 
the Java Virtual Machine software on each of the computing devices. The classes 
and the interactions between them are shown in Figure 4 - the classes are grouped 
into modules (as Indicated by the dashed-iine boxes). 

30 Much of the above program is explained in Bubak M, Plaszczak P, "Hydra - 
Decentralized And Adaptive Approach To Distributed Computing", Applied Parallel 
Computing, New Paradigms for HPC in Industry and Academia, 5* International 
Workshop, PARA 2000, 18-20 June 2000, Springer-Verlag Pp 242-9. The salient 
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features of the classes are given below together with a full description of the 
additions and alterations made in order to implement the present embodiment. 

As explained in that paper, the purpose of the software is to allow a task to shared 
5 amongst a plurality of computing devices. A user must provide a sub-class of a 
predetermined SimpleTask or CompositeTask abstract class in order to specify the 
task that he or she wishes to be carried out by the devices (218 - 225) included 
within the internetwork. 

10 Whenever a new task arrives at the computing device running the program, the 
Secretary module 106 handles its reception and stores it using the Task Repository 
108 module until the task is carried out as explained below. 

The Work Manager module 110 causes a task to be carried out if a task arrives at the 
15 computing device and the computing device has sufficient resources to carry out that 
task. Each task results in the starting of a new execution thread 112 which carries 
out the task or, in insufficient resources are available at the device, delegates some 
or all of the class to one of a selected subset (218-220, 225} of computing devices 
(218-225) which form a task group suitable for carrying out the task. The manner in 
20 which the task group (218-220, 225) is assembled will be explained below. 

The Guardian module 114 provides the interface to the other computing devices in 
the internetwork (Figure 1). It implements the communications protocols used by the 
system and also acts as a security firewall, only accepting objects which have come 
25 from an authorised source. The Guardian module uses Remote Method Invocation to 
communicate with other computing devices in the internetwork (Figure 1). More 
precisely, the NodeGatelmpI object encapsulates the RMl technology and implements 
the remote interface called NodeGate. 



30 



The Topology Centre module 118 maintains a remote graph data structure - a graph 
in this sense being a network comprising a plurality of nodes connected to one 
another via links. Each of the computing devices which is a member of the task 
group (218-220, 225) is represented by an RMl remote object in the remote graph 
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data structure. When computing devices connect to or are disconnected from the 
computing device network, this is requested using RM! and results in the computing 
devices updating their remote graph data structures accordingly. 

5 Lastly, the Initiator module comprises two objects. One, the Initiator object, initiates 
the computing device. The other, the ReferenceServer object, maintains the 
references to the created modules, 

Each of the computing devices (218 - 225) also stores a launch script. The 
10 processes carried out by each computing device on execution of that script are 
illustrated in Figure 5. 

Turning to Figure 5, the first stage (step 130) is the collection of information about 
the capabilities of the computing device on which the script is run. This involves the 
1 5 transfer of: 

a) information (available from the Linux operating system program) about the total 
and used amount of permanent memory to a permanent memory information file; 

20 b) information (available from the Linux operating system program) about the amount 
of volatile memory present (RAM and swap) to a volatile memory information file; 

0 information (available from the operating system program) about the Central 
Processing Unit (CPU) to a CPU information file; 

25 

d? information (available from the operating system program) about the latency 
experienced in communicating another computing device specified by the user in the 
script to a link information file; and 

30 e) information (available from the operating system program) about the average load 
experienced by the processor of the computing device to a utilisation information file, 
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Thereafter, in step 132, a MetaDataHandler execution thread is started together with 
another execution thread (step 140) which runs the Initiator ciass (Figure 4 : 120). 
The MetaDataHandler execution thread starts by generating 132 a profile XML 
document in accordance the DTD seen in Figure 2. 

5 

Many of the fields of the profile document are to be found in the files created at the 
time of the preliminary system information collection step (step 1 30) as follows: 

a) the OS Version field of the general information section 20 can be filled with a 
1 0 value taken from the system properties available from the operating system; 

b) all of the fields of the JVM section 22 can be filled from the system properties 
available from the operating system; 

15 c) the processor speed field of the CPU section 24 can be found from the CPU 
information file saved in the preliminary system information collection step (step 
130); 

d) all of the fields of the volatile memory section 26 can be found from the volatile 
20 memory information file saved in the preliminary system information collection step 

(step 1 30); 

e) all of the fields of the link section 26 can be found from the link information file 
saved in the preliminary system information collection step (step 130); 

25 

f) ail of the fields of the utilisation section 26 can be found from the utilisation 
information file saved in the preliminary system information collection step (step 
130); and 

30 g) all of the fields of the permanent memory section 26 can be found from the 
permanent memory information file saved in the preliminary system information 
collection step (step 130). 
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The remaining entries in the profile by utility software which forms part of the 
MetaDataHandier thread. 

The MetaDataHandier thread then opens a socket on port 1240 and listens for 
5 connections from other computing devices. The action taken in response to receiving 
a file via that socket will be explained below with reference to Figures 7 and 8. 

The part of the script which launches the Initiator class may include the RMI name of 
a computing device to connect to {it will not if the computing device concerned is the 
10 first node in the task group), ff it does, then the Initiator class results in an attempt 
to connect to that node. An example will now be explained with reference to Figure 
6. 

A script including a reference to the server 218 is run on the PC 219. As explained 
15 above, this results in the Initiator class 120 being run on the PC 219. This in turn 
requests HydraNodeConnector 150- to connect to the server 218 
{HydraNodeConnector is an interface for connection decision making, implemented by 
RegnoTopoiogvCentre 118). HydraNodeConnector decides to fulfil the request and 
sends it to Guardian 152, which passes it to NodeGateimpI 154. As mentioned 
20 above, NodeGateimpI encapsulates RMI technology. NodeGateimpI 154 uses Naming 
class (a standard RMI facility) to obtain a reference to NodeGate of the server 218 
(NodeGate is the node remote interface seen by other nodes, normally implemented 
by NodeGateimpI). As soon as it has the reference, NodeGateimpI 154 requests 
NodeGate of the server 218 to connect. The request contains the remote reference 
25 to RemoteGraphNode of the PC 219 and the XML profile document representing the 
capabilities of the PC 219. 

When received at the server 218, the request is passed to the Guardian and then to 
the HydraNodeConnector. As explained below, the MetaDataHandier thread 
30 determines whether the request to connect to the distributed computing network 
should be accepted and informs HydraNodeConnector accordingly. | n the present 
case, the connection is accepted. Hence, HydraNodeConnector supplies the local 
RemoteGraphNode with a reference to its counterpart on the PC 219 and orders the 
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RemoteGraphNode to establish a connection. The server 218 and the PC 219 
exchange references and link to each other using their internal connection 
mechanisms. 

5 The task group topology databases in the server 218 and the PC 219 are then 
updated accordingly, 

The response of a computing device running the MetaDataHandler execution thread 
to receipt of a profile XML document will now be explained with reference to Figure 
10 7. 

On receiving a profile file (step 170), the MetaDataHandler checks that the XML 
document is well-formed - a concept which will be understood by those skilled in the 
art (step 172). This check is carried out by an XML parser - in the present case the 
.5 Xerces XML parser available from the Apache Software Foundation is used 
Thereafter, in step 174, the MetaDataHandler recognises the input file as a profile 
which results in the use of an evaluateConditions method of a PolicyHandler class to 
check the profile against any policies stored in the computing device which has 
received the profile document. 

0 

This involves a comparison of the values stored in the profile which those stored in 
the policy. The nature of that comparison (i.e. whether, for example, the value in the 
profile must be equal to the value in the policy or can also be greater than) is 
programmed into the PolicyHandler class. To give an example, the policy example 
given above includes a value of 112000K between <HD> tags. The profile example 
9i ven above has two sets of data relating to permanent memory, one for each of two 
hard discs. The second set of data is: 



<HDTotal>16496< /HDTo tal> 
<HDUsed>J2007</HDUsed> 
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In this case, the PolicyHandler class is programmed to calculate the amount of free 
hard disc space (i.e. 4489K) and will refuse connection since that amount is not 
greater than or equal to the required 1 12000K of permanent storage. 

In step 178, it is determined whether al! the required conditions are met. If they are 
the connection is formed (step 180) and the task group topology data is updated 
(step 182) as described above. If one or more of the conditions is not met then the 
profile is forwarded to another node in the internetwork (step 184). 

10 If, on the other hand, the file received on the port associated with the 
MetaDataHandler execution thread is a policy, then the processing shown in Figure 8 
takes place. 

The first step is identical to that carried out in relation to the receipt of a profile file. 
15 After receipt (step 190), the file is checked (step 192) to see whether it is well- 
formed. Thereafter, the policy file is validated by checking it against the structure 
defined in the relevant DTD. As will be understood by those skilled in the art, the 
DTD may be incorporated directly in the policy file, or it can be a separate file which 
is referenced in an XML DOCTYPE declaration as a Universal Resource identifier 
20 (URI). The policy document therefore includes information on the location of the DTD 
to use - normally, the DTD will be stored at an accessible web server. Thereafter, 
the Network Policy subsystem is started (step 194). This then causes a check to be 
carried out to see whether the policy uses the correct date system and has sensible 
values for parameters (step 196). The computing device receiving the policy then 
25 extracts the domain and/or subject-list within the policy document (step 1 98). A test 
(step 200) is then carried out to see whether the receiving computing device is within 
a domain to which the policy applies or is included in a list of subjects to which the 
policy applies. 

30 If the computing device is not in the target group then it forwards the policy to its 
neighbours which are yet to receive the policy (step 202). This forwarding step is 
carried out in accordance with the so-called echo pattern explained in Koon-Seng Lim 
and Rolf Stadler, 'Developing pattern-based management programs'. Center for 
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Telecommunications Research and Department of Etectrical Engineering, Columbia 
University, NewYork, CTR Technical Report 503-01-01, August 6, 2001. The 
physical topology information 34 found in the profile is used as an input to this step. 

If the computing device is within the target group then it checks whether if already 
has the policy (steps 204 and 206}. If the policy is already stored, then it is just 
forwarded (step 208) as explained in relation to step 202 above. Alternatively, the 
current policy can be overwritten, thus providing a mechanism for updating a policy. 

10 If the policy is not already stored, then it is stored (step 210). Copies of the policy 
are then forwarded as explained above. It is to be noted that the policy may specify 
that the node receiving the policy is to re-send its profile to the node to which it 
initially connected. If this is combined with a replacement of the policy adopted by 
the node to which it initially connected, repeating the joining steps explained above 

15 will re-configure the distributed computing network in accordance with the 
replacement policy. 



An example of the operation of the above embodiment will now be explained with 
reference to Figure 9. In that diagram, the ellipses refer to computing devices in 
20 Figure 1, and are represented by IP addresses, the last three digits of which 
correspond to the reference numerals used in Figure 1 , 

The adminstrator of the internetwork of Figure 1 might wish to use spare computing 
power around the internetwork to carry out a complex computational task. To do 

25 this using the above embodiment, the administrator writes a policy which includes a 
first portion applicable to the domain including all computing devices having an IP 
address 132.146.107.xxx (say), which portion includes a first condition that the 
utilisation measured over the last 15 mins is less than 5% of processor cycles. The 
policy also includes a second portion which is applicable only to the server 218 and 

30 includes the additional condition that the processor speed is greater than 512 miiiion 
instructions per second. 
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He supplies that policy to the server computer 218 and runs a script as explained 
above, but without specifying the IP address of a host to connect to. Thereafter, he 
amends the script to specify the server 218 as the device to connect to, makes the 
condition relating to processor speed less stringent, and copies the amended policy to 
5 each of the computing devices within the internetwork. He then runs the script in 
numerical order of host addresses (i.e. he runs it on personal computer 219 first, 
then personal computer 220 etc). 

In this example, it is supposed that the resultant attempts to connect to the server 
10 218 by the personal computer 221 and the laptop computers 223 and 224 fail 
because their utilisation is greater than 5%. As explained in relation to Figure 7, 
those connection requests will then be forwarded to either the personal computer 
219 or the personal computer 220 which will apply the same policy and similarly 
reject the connection request. A similar outcome will result from the requests being 
1 5 forwarded to personal computer 220. 

However, the personal digital assistant might pass the utilisation test, but fail the test 
on processor speed. In this case, although the server 218 rejects the request, the 
personal computer 219 will accept the request. 

20 

It will be realised by those skilled in the art, that the resulting logical topology (which 
places the fastest processors closest to the centre of the task group) will result in 
better performance than had the personal digital assistant connected directly to the 
server 218. It will be seen how the generation of policies and profiles and 
25 comparison of the two prior to accepting a connection to a task group allows the 
automatic generation of a logical topology which suits the nature of the distributed 
task which is to be carried out. Thus, the same set of network nodes can be 
arranged into different distributed networks in dependence on policies which might 
reflect, for example, a requirement for large amounts of memory (e.g. in a file-sharing 
30 network), a requirement for low latency (e.g. In a multi-player gaming network), a 
requirement for stored energy to drive a radio transmitter (in an ad hoc wireless 
network) or a requirement for processing power (e.g. in a network performing a 
massive calculation). 
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Many variations on the above embodiment are possible. Some of the possible 
variations are listed below: 

5 i) Although the above embodiment concerned a distributed computer comprising a 
plurality of interconnected computing devices having both persistent memory and a 
processor, other embodiments of the invention might comprise a plurality of 
processors sharing a common memory; 

10 if) the internetwork might be much larger than that illustrated in Figure 1- for 
example, it might include other nodes connected to those shown in Figure 1 via a 
wide area network; 

iii) in the above-described embodiment, nodes applied to join the task group in 
15 response to the administrator running a script program on them. In alternative 

embodiments, a node already in the task group might ask its neighbours whether 
they have enough resources to meet the requirements of the policy for this task 
group. The comparison of the policy and the profile might take place in the applicant 
node, or in the responding node, or in a third party computer; 

20 

iv) in the above-described embodiment a logical network is created on the basis of a 
physical network as a precursor to distributing a computational task amongst the 
computers forming the nodes of that logical network. Similar techniques for 
generating a logical network based on a physical network might also be used in 

25 creating storage networks or ad hoc wireless networks based on a physical network 
topology. In those case, the task to be distributed would not be computation as 
such, but the storage of electronic data, or the forwarding of messages or packets 
across the network. 



30 
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1 • A method of dividing a task amongst a plurality of nodes within a distributed 
5 computer, said method comprising: 

receiving requirements data indicating desired properties of a task group of 
nodes and interconnections between them, which properties lead to said task group 
being suited to said task or tasks of a similar type; 

10 

calculating a task group topology in dependence upon said requirements 
data; and 

distributing said task amongst the plurality of nodes in accordance with the 
1 5 task group topology thus calculated. 

2. A method according to claim 1 wherein said topology calculation comprises 
the step of comparing said requirements data with node capability data for a node 
available to join said task group. 



20 



3. A method according to claim 2 wherein said requirements data comprises 
one or more property value pairs. 



4. 



A method according to claim 3 wherein said requirements data is arranged in 
25 accordance with a predefined data structure defined by requirements format data 
stored in said computer, said method further comprising the step of verifying that 
said requirements data is formatted in accordance with predefined data structure by 
comparing said requirements data to said requirements format data. 

30 5. A method according to any preceding claim wherein said node capability data 
comprises one or more property value pairs. 
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6. 



A method according to claim 5 wherein said node capability data is arranged 
in accordance with a predefined data structure defined by node capability format data 
stored in said computer, said method further comprising the step of verifying that 
said node capability data is formatted in accordance with predefined data structure 
5 by comparing said node capability data to said node capability format data. 

7. A method according to any preceding claim further comprising the step of 
operating a node seeking to join said task group to generate node capability data and 
send said data to one or more nodes already included within said task group 

10 

8. A method according to any preceding claim wherein said task distribution 
involves a node forwarding a task to a node which neighbours it in said task group 
topology. 

9. A method according to claim 1 wherein said requirements data comprises 
data relating to the amount of data storage or processing power available at said 
node. 



15 



10. A method according to claim 1 wherein said requirements data compnses 
20 data relating to the quality of communication between said node and one or more 

nodes already selected for said task group. 

1 1 . Distributed computer apparatus comprising: 

25 a plurality of data processor nodes, each connected to at least one other of 

said data processor nodes via a communications link; 

each of said nodes having recorded therein: 

30 a > group membership policy data; 



b} a list of group members; 
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c) processor readable code executable to update ^roup membership data, 
said code comprising: 

group membership request generation code executable to generate and send 
5 a group membership request including node profile data to another node indicated to 
be a member of said group; 

group membership request handling code executable to receive a group 
membership request including node profile data, and decide whether said request is 
10 to be granted in dependence upon the group membership policy data stored at said 
node; 

group membership update code executable to update the list of group 
members stored at said node on deciding to grant a group membership request 
1 5 received from another node, and to send a response to the node sending said request 
indicating that said request is successful. 



12. Distributed computer apparatus according to claim 11, wherein each node 
20 further has recorded therein node profile data generation code executable to generate 

said node profile data. 

13. Distibruted computer apparatus according to claim 11 or claim 12, wherein 
each node further has recorded therein group membership policy data distribution 

25 code executable to distribute said policy data, said policy distribution code 
comprising: 

policy input code operable to receive policy data; 

30 policy storage code operable to store said received policy data at said node; 

and 
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policy forwarding code operable forward said policy from said node to at 
least one other node in said distributed computer apparatus. 

14. Distributed computer apparatus according to any one of claims 11 to 13, 
5 wherein each node further has recorded therein 
policy format data; and 

policy data format verification code executable to check that said received policy 
data accords with said policy format data. 

10 15. Distributed computer apparatus according to any one of claims 11 to 14, 
wherein each node further has recorded therein 
profile format data; and 

profile data format verification code executable to check that said received node 
profile data accords with said profile format data. 



15 



16. Distributed computer apparatus according to any one of claims 11 to 14 
wherein each node further has recorded therein received program data execution 
code executable to receive program data from another of said nodes and to execute 
said program. 



20 



17. 



Distributed computer apparatus according to claim 16, wherein said plurality 
of processor nodes comprise computers executing different operating systems 
programs, and said received program execution code is further executable to provide 
a similar execution environment on nodes despite the differences in said operating 
25 system programs. 



30 



18. A method of operating a member node of a distributed computing network, 
said method comprising: 

accessing membership policy data comprising one or more property value 
pairs indicating one or more criteria for membership of said distributed computing 
network; 
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receiving, from an applicant node, profile data comprising one or more 
property value pairs indicating characteristics of the applicant node; 

determining whether said applicant profile data indicates that said applicant 
5 node meets said membership criteria; 

responsive to said determination indicating that said applicant node meets 
said membership criteria, updating distributed computing network membership data 
accessible to said member node to indicate that said applicant node is a member 
1 0 node of said distributed computing network. 

19. A method according to claim 18 wherein said member node stores said 
distributed computing network membership data. 

15 20. A method according to cfairn 19 wherein said member node stores said 
membership policy data. 

21 . A method according to claim 20 further comprising the steps of: 
20 updating said membership policy data; 

removing indications that one or more nodes are members of said distributed 
computing network from said distributed computing network membership data; 

25 sending an indication to said one or more nodes requesting them to re-send 

said profile data. 

22. A computer program product ioadable into the internal memory of a digital 
computer comprising: 

30 

task group requirements data reception code executable to receive and store 
received task group requirements data; 



WO 2004/001598 



FCT/GB2003/002631 



node capability profile data reception code executable to receive and store 
received node capability profile data; 

comparison code executable to compare said node capability data and said 
5 task group requirements data to find whether the node represented by said node 
capability data meets said task group requirements; 

task group topology update code executable to add an identifier of said 
represented node to a task group topology data structure on said comparison code 
10 indicating that said represented node meets said requirements; 

task execution code executable to receive code from another node in said 
task group and to execute said code or forward said code to a node represented as a 
neighbour in said task group topology data structure. 



15 



23. A method of operating a network to create a logical network topology based 
on the physical topology of said network, said logical network topology being suited 
to a task, said method comprising: 

20 identifying a member node as a member of said logical network; 

storing requirements data representing what is required of nodes in order for 
them to be suitable for said task; 

25 storing candidate node capability data representing the capabilities of a 

candidate node in said physical network; 

operating a candidate node in said network to compare its candidate node 
capability data with said requirements data; 

30 

responsive to said comparison indicating that said candidate node to meet 
said requirements, making said node a member of said logical network. 
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Fig.3 (Cont i). 
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Fig.3 (Cont ii). 
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Fig.6. 
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Fig.7. 
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Fig.8. 
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Fig.9. 




SUBSTITUTE SHEET (RULE 26) 



